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HIGHER-ORDER ASYMPTOTIC NORMALITY OF 
APPROXIMATIONS TO THE MODIFIED SIGNED 
LIKELIHOOD RATIO STATISTIC FOR 
REGULAR MODELS^ 

By Heping He and Thomas A. Severini 

Northwestern University 

Approximations to the modified signed likelihood ratio statistic 
are asymptotically standard normal with error of order , where 
n is the sample size. Proofs of this fact generally require that the 
sufficient statistic of the model be written as {9, a), where 9 is the 
maximum likelihood estimator of the parameter 6 of the model and 
a is an ancillary statistic. This condition is very difficult or impossi- 
ble to verify for many models. However, calculation of the statistics 
themselves does not require this condition. The goal of this paper is 
to provide conditions under which these statistics are asymptotically 
normally distributed to order without making any assumption 
about the sufficient statistic of the model. 

1. Introduction. Let Yi,Y2, . . . ,Yn be independent and identically dis- 
tributed random variables, each distributed according to a distribution with 
density function p{y; 6), 6 £Q. The likelihood function for 6 based on Yi,Y2, 
...,Yn is given by 

n 

m = 1(9; Yi,Y2,..., y„) = l[p{y^; 9), 9^0; 

i=l 

let i{9) = logL{9) denote the log-likelihood function. 

Suppose that 9 = (V'jA), where tp is a scalar parameter of interest and 
A is a nuisance parameter. Inference about "0 can be based on the signed 
likelihood ratio statistic R, 

R ^ Rii,) = sgnii^ - mm - m))]'^^^ 
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where 6 denotes the maximum Ukehhood estimator of 9 and 9^ denotes the 
maximum hkehhood estimator of 9 with ■0 held fixed. Under standard reg- 
ularity conditions, R is asymptotically distributed according to a standard 
normal distribution with error 0{n~^^'^); see, for example, [4]. 

Adjustments to R have been proposed which reduce this error to 0(n~^) 
or even 0(n~^/^). One such statistic is the modified signed likelihood ratio 
statistic R* , proposed by [2] . General discussions of the derivation of R* and 
its properties are given in [3, 4, 5, 13, 17] and [23]. The analysis in these 
papers is based on the following assumption: 

Assumption 1.1. The sufficient statistic for the model may be written 
as {9, a), where 9 denotes the maximum likelihood estimator of 9 and a is 
an ancillary statistic. 



Here ancillarity is taken to mean that the distribution of a does not de- 
pend on 9, although if a is used in Assumption 1.1, it must satisfy the 
additional requirement that {9, a) is sufficient. Under Assumption 1.1, the 
log-likelihood function i{9) may be written as i{9;9,a) to emphasize that it 
is a function of the sufficient statistic {9, a) as well as the usual argument 9. 
Note that some distributions, such as full-rank exponential family distribu- 
tions and certain transformation models, satisfy this assumption; however, 
for other types of models, it is often very difficult or impossible to verify 
Assumption 1.1. 

The modified signed likelihood ratio statistic R* is given by 



R* 



1 fU 



where 



09 



and J ■ 



dH{9^;9,a) 



8X89 



The sign of U is taken to be the same as that of R so that U/R is never 
negative. In the moderate-deviation case, R* is asymptotically normally dis- 
tributed with error 0(n~^/^), while in the large-deviation case R* is asymp- 
totically normally distributed with error 0{n-^); see [2]. Note that the errors 
in both cases are uniform and relative. 

For models in which Assumption 1.1 cannot be verified, computation of 
U is difficult or impossible. [10] uses a variable T in place of U; Assumption 
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1.1 is not needed for determination of T. However, it does require a prior 
density function for 6. [22] and [18] propose, respectively, an approximation 
R* to R* based on covariances and an approximation R* to R* based on 
empirical covariances. 

The covariance-based approximation is based on the fact that, in the 
expression for [/, i_.g{0) — i,.§{0) and ^0.§{O) may be approximated by 

1.00) - l./o) = {Q{e- 6) - Q{e; e)]i{ey\j 

and ig.§{0) = I{9;9)i{9)~^ J respectively, where 

I{e; Oo) = E[£e{e)ee{Oof; ^o], ^o) = ^[^(0)^J(eo); ^o] 

and i{6) =I{6;9). Let U denote the approximation of the statistic U based 
on the above approximation; then an approximation to R* is given by 

^* = ^ + |iog|; 

see [22] for further details. 
Let 

and i{6) = I {6; 9), where £^^\6) denotes the log-likelihood function based on 
the jth observation alone. Then i_.g{6) — £..§{0) and £q.q{0) may be approx- 
imated by 

and lg,g{6) = I{6; 6)i{6)^^ J respectively. Let tj denote the statistic U based 
on these approximations; then an approximation to R* is given by 

R* = R+^\og{lJ/R)- 

see [18] for further details. 

The higher-order asymptotic normality of R* and R* has been established 
by [22] and [18], respectively, under Assumption 1.1. The goal of this paper 
is to prove that these statistics are asymptotically normal with error 0{n~^) 
without requiring Assumption 1.1. 

2. Notation and regularity conditions. For n = 1, 2, . . . , let 1" = (Yi ,Y2,..., 
Yn), where Yi, • • • ) ^ are i.i.d. random vectors with each of dimension do 
and let p{-,0) denote the density function of Yi. Here ^ is a /c-dimensional 
parameter of the form 

9 = {01,02, ...,0k) = (V^, Ai, A2, . . . , A,-,i) = (V', A), 
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where V' is the scalar parameter of interest and A is the nuisance parameter 
vector. Let L{6) = L{9; Y) denote the hkehhood function for € and Y G 
j^nxdo and let 1(9) = \ogL{e). For each 6* G 6, let 

^e = {y G7^"^'^°|L(0;y) >0}. 

For r, s = 1, 2, . . . , fc, define 



do ' " ' dede^ 

-W= ..iT.. m and W.W 



Assumption 2.1. Assume that 9 is an open subset of TZ''. 

1. i{6) is five times continuously differentiable at each 9 £ Q with respect 
to 9i, i = l,2,...,k, for ah Y £ Eg; 

2. j4-my)dy = J^Li9;y)dy = J ^^^L{9;y) dy = 

/Mr9e7ae7e57-^(^;y)'^y = 0;i,j,K,£ = 1,2,...,A;, for each 61 G G; 

3. " Var{£^(0)} = E[£l{9)] > , Var{£A(^)} = E[ix{9)ix{9)'^] is positive 
definite, for each 9 £ @; 

4. {^eS^)^^djeki^)^^ei9m9p{0)Jeqer9seti0)) has joint cumulants up to third 
order, where i,j, K,i,m,p,q,r, s,t = 1,2, ... , k; 

5. The maximum likelihood estimator of 9 is consistent as n ^ oo. 

Conditions ensuring that part (5) of Assumption 2.1 holds are given, for 
example, by [1, 24] and [16]. 

Let £^^\9) = logp{Yi;9), i = 1,2, . . . ,n. Then, for r, s, t = 1, . . . , A;, we have 

n n 

m=Y^i^H9), ig{9)=Y^if{9), 

i=l i=l 

n n 

i=l i=l 

For r = 1, . . . ,k, let 

i=l 
i=l 
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where Vee = E[lf, {6)1 Veee. = E[£fl^ (9)] , i = 1,2, . . . ,n. Let 
Z = {Zq, Z^q, Z\^\, Z\^\, Zx^_^x, Z^^^,Z^^\, 
Zipx^x, Z^x^Xi • • • ) Z.ipx,._^\i Zx^XiXi ZxiX2Xj • • • i 

■^AiAfe_iA5 -^A2A2A5 -^A2A3A5 • ■ • , -^A2Afc_iA5 • • • , Zx^_jXk-i\)'^ ■ 

Let d denote the rank of the covariance matrix of Z. By the spectral decom- 
position of the covariance matrix of Z, there exist a matrix T = {tij)dx{k+k'^+k^) 
and a random vector X with d elements such that X = T ■ Z, Cov(X) 
and Z ={T'T)-^T'X. Let 

• • • + *l,fc+fc2+fc3 (61) - yAfc_i Afe_iAfc_i ) 
^hM+k-^+k^i^x'k-iXk-iH-S^^ ~ ^^fc-iAfe-iAfe-i) 



ixd 



Yi 



where i = 1,2, . . . ,n. Obviously, we have X = X^iLi Cov(yj) = Idxd- 

Let II • II denote the Euclidean norm. 

Assumption 2.2. The following three points are assumed: 

L The distribution of Yi has a finite cumulant generating function in 
a neighborhood of the origin, that is, | log(-E[exp{< t, Yi >}])| < +00, where 
||t|| < e for some e > 0. 

n. The characteristic function ^ of 1^ satisfies Cramer's condition, that 
is, for some k> 0, sup{|^(t)|; ||t|| > fc} < 1. 

in. Some power of ^ is integrable, that is, (,{t)"' dt < +00 for some 
real number a> 1. 

Condition II can be verified by applying the Riemann-Lebesgue lemma; 
see, for example, [7] . Condition III can be verified by applying a result such 
as Lemma 2.4.3 in [14]. 

3. Main result. The following theorem is the main result of the paper. 

Theorem 3.1. Assume that the Assumptions 2.1 and 2.2 hold. Then, 
uniformly for — co < t < 00, we have 



Pr{R* < t) 



exp 
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and 

Pr{R* <t)= -i= exp dx [1 + 0{n-% 

That is, R* and R* converge in distribution to standard normal random 
variables with the error of order of . 

Note that the 0{n-^) errors in the normal approximations to the distri- 
bution functions of R* and R* are relative and uniform in t, the argument 
of the distribution function under consideration. The uniformity follows di- 
rectly from Theorem 3.2 of [19], while relativeness follows from the fact that 
the cumulative distribution function of a standard normal random variable 
is 0(1) as n — > oo. 

The proof of Theorem 3.1 is based on the following lemma. 

Lemma 3.1. Assume that Assumption 2.2 is satisfied. Define X as in 
Section 2; then 

Pr{XeB)= f U{u)du + o{n-^), 
Jb 

where E{\\X\\^} < +oo; B is any Borel set in IZ'^; ^n{y) =J2r=oP'ri—4'- 
{Xv,n})iu); Pr{—(j):{xv,n})iu) is the density function of the finite signed 
measure with characteristic function Pr{it : {Xv,n}) exp{— t E R'^, r = 
0,1,2; Pr{z : {xv,n}), = 0,1,2, are Cramer-Edgeworth polynomials defined 
in [6]; and Xv,n-, 1 < u < 4 are the cumulants of X, satisfying xi,n = 0, X2,n = 
l-nd. That is, equations (3.1)-(3.3) in [19] are satisfied for s = 4. 

Proof. [21] gives conditions for the validity of multivariate Edgeworth 
expansions for a sequence of random variables. We check those conditions 
so that we can use [21] to prove this lemma. 

Using the properties of X given in the previous section, condition I of 
Assumption 2.2 implies condition (i) in Corollary 4.2 of [21] and condition 
II of Assumption 2.2 implies condition (ii) in Corollary 4.2 of [21]. It is 
trivial to verify that condition (iii) in Corollary 4.2 of [21] is also satisfied. 
Condition III in Assumption 2.2 implies that some power of ^ is integrable. 
Therefore, the conditions of Theorem 3.1 in [21] for s = 4, Pi^n{t) = On.(i)~^ — 
n~^/^,e„ = n~^/^ follow from Corollary 4.2 in [21]. 

Applying Theorem 3.1 in [21] shows that equation (3.7) in Theorem 3.1 
in [21] holds for s = 4,e„ = and, hence, that condition in Corollary 

(3.3) of [21] is satisfied. Therefore, equation (3.10) in Corollary (3.3) of [21] 
gives that 

Pr{X £B)= [ U{u) du + o(n-i), 
JB 
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where B and ^n{u) are the notation explained in this lemma. By Assumption 
2.1, it is obvious that < oo. Therefore, equations (3.1), (3.2) and 

(3.3) in [19] hold for s = 4. □ 

Proof of Theorem 3.1. We begin by outlining the basic idea of the 
proof. Suppose that a sequence of distributions can be approximated to a 
certain order of accuracy by an Edgeworth series; then Theorem 3.2 of Skov- 
gaard [19] shows that such an expansion may be transformed by a sequence 
of deterministic or stochastic smooth functions of the corresponding ran- 
dom vectors to yield another Edgeworth expansion of the resulting sequence 
of distributions. The terms in this expansion may be calculated from the 
moments obtained by the delta method, that is, the moments formally cal- 
culated from a Taylor series expansion omitting terms of high order. Thus, 
to prove the theorem, we use Lemma 3.1 to obtain an Edgeworth series ap- 
proximation to the distribution of X and then, in Section 5, show that R 
has an expansion in terms of X. Theorem 3.2 of [19] then gives an Edge- 
worth series approximation to the distribution of R ; the same approach can 
be used for R* . As noted above, the uniformity in Theorem 3.1 follows from 
the uniformity in equation (3.13) of Theorem 3.2 of [19]. 

Lemma 3.1 shows that equations (3.1)-(3.3) in [19] hold. Note that R* 
does not satisfy the first part of equation (3.4) of [19]; thus, we begin by 
constructing a location adjustment of R* . Let 

^ = -R* -I- [g(-V0^) ^^'^Vjjj^^ — ^{-V^^) ^^'^ t^:{V^^^Vx\^,) 

Expanding the corresponding likelihood equations shows that 6 and 9^ can 
be considered as stochastic functions of Z; see [20], particularly equation 
(6.2). The formula of R contains 9 and 9^. By its expansion, R can be 
similarly considered as a stochastic function of Z and it is equal to when 
Z = 0. Hence, R satisfies the first part of equation (3.4) in [19]. However, 
R* considered as a stochastic function of Z is not equal to zero when Z = 0. 
Hence, Theorem 3.2 in [19] can be applied only to R to obtain its asymptotic 
distribution. Note that the function /„ in Theorem 3.2 in [19] can be a 
stochastic function; see Remark 3.8 in [19]. The asymptotic distribution of 
R* is obtained by reversing the location adjustment in the final part of this 
proof. 

By using Taylor series expansions and collecting terms by orders of n"^/^, 
R may be expanded, 

R = {—Vjp^)~^^^Z^, 
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(3-1) - ^(-"^/.v) ^^^^V^A^AA^^^A^?/; 

where R{n~^) represents a finite number of terms of order such that the 
first four cumulants of nR{n~^) are bounded in n; see Section 5 for details 
of the derivation of equation (3.1). Even though we can obtain the specific 
form of R{n~^) by expanding R* to order n^/^, we omit its specific form 
since it is extremely tedious. Note that Z^, Z\, ... in equation (3.1) may be 

viewed as functions of X. Thus, we can write R = f{X,uj), where f{-',oj) 
represents the function corresponding to the first three terms in equation 
(3.1); uj denotes the sample point of the underlying experiment and accounts 
for the contribution of the Op term in (1). It follows that Theorem 3.2 in 

[19] can be applied to R ; see Remark 3.8 of [19]. 

We know from equation (3.1) that at X = 0, ^ is four times differ entiable, 
R (0) = and DR (0) is of rank one; it follows that equation (3.4) in [19] 
holds. It is shown below that R has asymptotic variance 1; hence, R does 
not have to be normalized as in equation (3.5) of [19]. 

Write R = R + Op{n~^^'^), where R denotes the first three terms on 
the right-hand side of equation (3.1). Note that ^ is a function of X. By 
the uniqueness of power series expansions, R agrees with the Taylor series 
expansion of R with respect to X up to a polynomial of a finite number of 
terms, neglecting terms of order Op(n~^/^). 

Using the expression for R given in equation (3.1), we obtain the following 
expression for i?[^]: 

- {-V^^)-'/'E[Z^,V^^^Z,] 

+ ^(-^t/'t/')~^''^Kw'A^AA^^^A 

+ ^i-V^^)-'/'E[ZlV^^'V^xxVxxZx] 
= {^(— K/)»/)) ^^'^v^,jIj^ + ^{—Vi^i)) '^^'^Vipipip 

-i(-F^^)-^/'tr(y,-,VAA.^)}n-V2 + 0(n-^). 
Similar computations show that 

V{R) = l + Oin-^), 
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K3{R) = 0{n^^) and IU{R) = 0{n~^). 
Let rjn be the density function with characteristic function 

2 

rjn{t) =exp{i(t,xi,n) - lx2,n{t,i)}^ Priit: {Xv,n}), 

r=0 

where 

Xl,n = [^{ — V^^)~^^'^v^^^^ + ^{ — Vjp-^)~^^'^V^^^ 

-i-V^i,)-'^'triV,-,Wx^) 

-^(-^^vO-'/'tr(y,-^VAA^)]n-V2 + o(n-i), 

X2,n = l + 0(n^i), X3,n = 0{n^^), X4,n = 0(n^^). 
Define 

p„(a) = (logn)V2(2 + a)i/2, a > 0, 

and 

Hn{a) = {t£ ||t|| < a > 0. 

We now verify Assumption 3.1 in [19]. For all a > and all sufficiently 
large n, we have the following: 

1. ^ is four times continuously differentiable on Hn{a), and 

sup{\\D^R*{t)\\ I t G Hnia)} = o{n~^). 

2. Define A„ = sup{(||DJ-R*(0)||/j!)i/(-'-i) |2 < j < 3}, then X^ = o{n-^). 

The continuous differentiability of R claimed in point 1 requires some clar- 
ification. Note that R* has a singularity at points where R = and U = 0. 
However, the singularity is removable. Whenever i? = 0, we must have = ^, 
from which U = follows. When ip approaches iJj, equations (5.11) and (5.16) 
in Section 5 show that R = 0{{tjj — ip)) and equations (5.7), (5.8) and (5.11) 
show that IJ = 0{{ijj — ip)). Hence, U and R approach zero at the same rate 
whenever R goes to zero. Furthermore, equation (5.14) shows that U /R goes 
to 1. Therefore, the singularity is removed. 

Therefore, we have shown that all conditions in Theorem 3.2 in [19] are 
satisfied for q = p = s = 4; it follows that 



r 2 

Vn{t) = 



Lr=0 



X = x-Xl,: 
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<Po,X2,n-{Xv,n})ix) 



1 



2vryx 



: exp 



2,n 



X 



2X2,n/ 



-Pl(-<?^0,X2,n :{Xt;,n})(2;) 
X3,n 1 



6 V2^yX2^LX2,n 
P2i-<l)0,X2,n-{Xv,n}){x) 

X4,n 



3x / X 
— exp( - — 



2X2,n/ Xin 



X f X 

— exp( 



2X2, 



24V2^Vxi; 



3 

— exp 



X2,n 



X 



2X2,ny X2,n 
„4 



exp 



2X2,n 

^2 



+ 



xl 



72V2^yx^ 



15 



Xtn V 2x2,n 



x^ \ 45x / x^ 
expl -77-: — +-r^exp -— — 

2X2,n/ X2n V 2x2,n 



15x^ 

-75— exp I - , ' -ti 

xin V 2X2,ny X2 



X fx 



2X2,n 



Let 



Finally, it follows from equation (3.13) in [19] that 
Pr{R* < t) 

= Pr{R* <t + C) 

rC+t 2 /j^ 
= / '^Pr{-(t>0,X2.n-{Xv,n})\x=x-cdx + o[- 



■* 1 



00 



2vryx2^ 



: exp 



X 



2X2,r 



dx 



+ X3,r 



1 1 



3x 

X2,„ V 2x2,n 
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exp 



2X2, 



dx 



+ X4,n 



xh 



■ exp 



6x 

Xlr 



X 



■ exp 



+ Xin 



X2,n 
15 
X2,n 



■ exp 



exp 



2X2,n 
„2 



X 



+ -TTi— exp 



X2,n 



exp 



+ - 



exp 



2X2,n 

2X2,n 

2X2,n 

2X2,n 
2 



dx 



2x 



2,n 



dx + O I — 

n 



Note that 

X2,n = 1 + O 
Therefore, we have 



Pr{R* < t) 



X3,n = O 



1 



X 



X4,n = O 



dx + 0{- 

n 



The proof for R* is very similar. We can expand R* to the third order and 
the k + + k"^ elements in the vector Z appear in its expansion as well. 
Since R* = R* + Op{l/n), the differences between the expansions of R* and 
R* exist only in terms of order or higher. The expansion of R* has 
the first, second, third and fourth order cumulants equal to the ones of the 
expansion of R*, up to the order 0(n~^). Therefore, similar computations 
give 



Pr{R* < t) 



' 1 

— exp 
oo 27r 



— ]dx + 0[- 

n 



which finally concludes this proof. □ 
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Table 1 
Remission times for patients 



1 


1 


2 


2 


3 


4 


4 


5 


5 


6 


8 


8 


9 


10 


10 


12 


14 


16 


20 


24 


34 





4. An example. The linear-exponential model is used in the analysis 
of survival data. Under this model, survival times are assumed to have a 
distribution with density of the form 

/(y) = (^ + Ay)exp[-('0y + iAy2)], y > 0, 

where ip > and A > are unknown parameters; note that this is not an 
exponential family model. The log-likelihood function, based on the inde- 
pendent survival times yi, . . . , y„, is given by 

n n 

m = 5]log(V + Xyi) - J2i^Py, + IXyf). 

1=1 i=l 

For this model, it is very difficult or impossible to verify Assumption 1.1. 
However, Assumptions 2.1 and 2.2 can be quite easily checked. Consider 
Assumption 2.1. Part 1 of this assumption is naturally satisfied. Part 2 
follows from applying Corollary 2.4.1 in [8] on interchanging the order of 
differentiation and integration. Direct computation can be used to establish 
part 3; since the cumulant-generating function of the first four log-likelihood 
derivatives exists, part 4 of Assumption 2.1 is satisfied as well. Now consider 
Assumption 2.2. Since Yi has a cumulant-generating function for this model, 
part I is satisfied. Applying the Riemann-Lebesgue lemma in [7] and Lemma 
2.4.3 in [14] establishes parts II and III, respectively. 

Thus, it follows from Theorem 2.1 that the modified versions of the signed 
likelihood ratio statistic, R* and R* , are each asymptotically normally dis- 
tributed with error of order o(n~^). 

The data in Table 1 are from Example 7.2 in [15]; the values represent 
remission times in weeks for 21 patients with acute leukemia. Using this 
data and the linear-exponential model, confidence limits for ip based on 
R, R* and R* were calculated; these are presented in Table 2. Table 2 
also contains the results of a small simulation study designed to estimate 
the coverage probabilities of confidence limits based on R, R* and R* . In 
the simulation study, the data were drawn independently from a linear- 
exponential distribution with the parameter values taken to be the maximum 
likelihood estimates based on the data in Table 1. A Monte Carlo sample 
size of 100,000 was used. 
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5. Asymptotic expansion of R*. We now consider the expansion R* used 
in the proof of Theorem 3.1. Recall that, for 9 = (61,62, ■ ■ ■ , 6^), ijj = 61 and 
X = {62,63,. .. ,dk)- Without loss of generality, we assume that ijj and A are 
orthogonal parameters; see, for example, [9, 11, 12] and [4] (Section 2.7). 

We begin by expanding {i_.g{6) — (■..§{61^))'^ 

(5.1) ' ' ^ 

s,t=l 

where fJ,e,e,eti(^) = -E'(4(^)4.et(6'); 6*), 5 = 6-6^. The approximation ^g.g{6^) 
to ^g.§{6^) can be expanded, 

k 

(5.2) £^.^(6^) = J - E f^9,oeMSti-\0)J + Op(l), 

t=i 

so that ^x-e^^i^) expanded, 

k 

(5.3) 1^/6^,) = Jxe -Y.^5tiix,eeAG)i~\0)J + Op{l). 

t=i 

Now let us turn to Taylor series expansion of the determinant of the 
asymmetric matrix A + X, where A = (aij) and X = {xij) are two square 
matrices of the same order. Then 



\A + X\ = \A\+Y.^-\^l_x.,+0{xl) 



Table 2 

Upper confidence limits based on R, R* and R* 



Confidence limit Coverage probability 



Probability 


R 






R 


R' 


R* 


0.010 


0.0206 


0.0260 


0.0263 


0.0032 


0.0125 


0.0126 


0.025 


0.0293 


0.0353 


0.0356 


0.0150 


0.0261 


0.0264 


0.050 


0.0373 


0.0439 


0.0443 


0.0397 


0.0526 


0.0526 


0.100 


0.0472 


0.0545 


0.0550 


0.0745 


0.1100 


0.1102 


0.900 


0.1327 


0.1372 


0.1375 


0.8840 


0.8990 


0.8991 


0.950 


0.1441 


0.1469 


0.1472 


0.9366 


0.9467 


0.9469 


0.975 


0.1540 


0.1557 


0.1559 


0.9661 


0.9742 


0.9748 


0.990 


0.1657 


0.1664 


0.1667 


0.9808 


0.9900 


0.9902 
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d\A + X\ 



1^1 +E 



-f d{aij + X 



x=0 



(5.4) 



\A\ + |(A + X),,- 1 ^^x,, + 0(x 



|^|+$:(-ir+^|A,,|rr,,+0(x2,) 



1^1 +tr(adj(A)X) +0(x: 



for any s, i, 



where |(^ + is the minor of aij + in |A + X|; \Aij\ is the minor of 
aij in 1^1; adj(^) is the adjugate matrix of A\ tr(adj(A)X) is the trace of 
adj(^)X. 

RecaU that U is given by 



(5.5) 



Substituting equations (5.1) and (5.3) into equation (5.5) and applying equa- 
tion (5.4) gives 



U - 



(5.6) 
Let 

(5.7) A- 



s,t=l 

k 

t=i 

x|jAA(^^)r'/'ijr'/'+Op(n-i). 



Ik \ 



X 



s,t=l 
k 



V 



t=l 



J 



and note that ^ + X is asymmetric. Applying equation (5.4) once more 
produces 



(5.8) 



tJ = \A + X\\j^^{d^)\-^I^\J\-^I^ + 0,{n-^) 

+ iv{^dmX)\hx{e^)\-^l''\J\-^'^ + 0,{n-^). 
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Let 
(5.9) 



B 



{e-9j,YJ 

J\8 



which is the first term of equation (5.8) divided by R. Using the formula for 
the determinant of a partitioned matrix, an alternative form for B is 

B = I JaaI [(^ — 0^))'^ Jeip — {0 — 9^)'^ Je\Jx\J\ip\ 
(5.10) X \hx{9^T^/Vx\\^^'^R~V^^ - Ji,xJxlJx^]~^'^ 

R\jxx{e^)\"^ 

Hence, in order to find expansion of we have to find an expansion of R~^. 
Note that 



(5.11) A - = -(V' - V) Ja"a >^A^ - hi^ - i'fJxx^x^A^) + Op(n-^/'). 



Therefore, we have 



1 



— =sgn(^/>- V)< IV'-V'I 



1 7-1/2 



R 



Ipip 



6' 



(5.12) 



51 ^ereset{9)5r^s5t 



r,s,t=l 



(^-V)-'J7^/' 



X! ^ereset{9)6r5s6t 



r,s,t=l 



+ Op(n-i). 



Using 



UAA(^^)r^/' = \Jxxt'" - \\Jxx\~"'tr(^^'^]{Jxx) (E- 

(5-13) 



AA0, 



+ Op(n-('=/2)-{V2). 



together with equations (5.12), we obtain the following expansion of B: 
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X tr l^adj(JAA) (^E^AAe.(^)^.j j + Op{n'^)^ 
1 - ^ I Jaa r ^ tr (^adj ( Jaa ) (^E ^AAe. j ^ 



r,s,t=l 

Now consider expansion of R* . Note that 



i?+ilog|5 + 



tr(adj(yl)X) 



i2bAA(^^)P/2|J|l/2 

(5.15) =/?-^(^-V')-VAA|-'j;^'/'tr(^adj(JAA)(^E^AA.W5'j 



+ ^(V^-V')-%T 



R 



{e-e^,fj 



Using the expansion 

R = sgn(^ - ^)\[ie - e^fj{e - e^)]'/^ 



(5.16) 



.r,s,t=l 



+ Op(n-i) 



E 4.e.e,(^)<5ris5t + Op(n-^) 
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for R in equation (5.15) yields 



{k 
r,s,t=l 
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(5.17) 



r,s,t=l 



\r=l 



+ 



1 tr(adj(^)X) 



R 



+ Op(n-i) 



In order to obtain an expansion of R* in terms of log-likelihood derivatives, 
each term in equation (5.17) can be expanded. Let 



(5.18) 



1 

/n 



Zee = -^MO) - nVee), Vee = -E[lee{e);e]. 
\ n n 



Note that we have 
(5.19) 



Z^x — —^^ipx{(^) 



n 



because of orthogonal parameters. We continue to set 

1 



(5.20) 



Z, 



n 



where Ve^e^et = ^-£^[^e,e,0i(6');6'], r, s,t = 1, 2, . . . , fc. 

The expansion of the first term of equation (5.17) of R* is given by 

= (— ^i/)t/))^^^^v 



+ 



7^( — K/)i/)) '^^'^Z^^Z^ 
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(5.21) - {-v^^y^i^zl^v^^zx 

+ Op(n-i). 

The expansion of the second term of equation (5.17) of R* is given by 

k 



n 



r,s,t=l 



-1/2 



(5.22) 



= b(-^^^)"'^'^^^^4^"'^' + Op{n-^). 
The expansion of the third term of equation (5.17) of R* is given by 

k 

= -\{-V^^r'Z-^-'n^l\-V^^)-^l'n-'l' 

X (-^^^)"V^^^Z^n-i/2 ^ Op{n"^) 
= -g(-^^^)~'/V^^^n-V2 ^ 0^(^-1). 

= -vyiVxx^z^V^ + Op{i). 

The expansion of the fourth term of equation (5.17) of R* is given by 

_l(^_^)-l|J,^|-lj-V2^^|^^dj(JAA)E^AA.(^)<5.j 

= -\{-V^^)Z~^'n''\-V,,,,r'''n^''' 

X tr((-n"i)y,",i(-y-;)yAA^z^^) + Op{n-^) 



(5.23) 



(5.24) 
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Finally, we have the following expansion of the fifth term of equation 
(5.17) of R*: 

tr(adj(A)X) 

= ^tT{A-'X) 



(5.25) 



1 



-n 



3/2(-y^^)-3/2 



1 



n 



-1/2 



2 

+ Op(n"i). 

Using the results in equations (5.21)-(5.25) in equation (5.17) yields 

R* = {—V^^)~^^'^Z^ 

- \{-vi,^)~'^^'^v^^yyy^-^ ZxZ^ 

(5.26) + \{-V^^)-^'^ZlV^^'V^xxV^x'Zx 



+ 



+ 



-V^^)-'/'tr{v^lVxxi,) 



2( '^ipip') ' ^ '^ip^ipip 



+ i-V^^)-^^^ tr(V7^ii;A,A^)]n-i/2 + Op{n-^), 



where 



This expansion has a remainder term of order Op(n~^). The same general 
approach can be used to obtain an expansion of R* with a remainder of 
order Op(?i~^/^). Such an expansion has the form 

R* = (_y^^) ^/^Z^ 
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+ \{-V^^)-^I^ZlV^^V^xxV^^^Zx 
(5.27) +i(_y^^)-i/2tr(t;-^VAA^) 

+ i2(n-^)+Op(n-3/2), 

where R{n~^) represents a finite number of terms of order n~^. The specific 
form of R{n~^) is omitted since it is extremely repetitive and tedious; it 
includes log-likehhood derivatives of the form Zq^q^q^ ,r, s,t = 1,2, ... ,k. Note 
that, since R{n~^) represents a finite number of terms of order n~^, it is a 
polynomial of Z such that E[R{n~^)] = 0{n~^). 
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